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DETAILED ACTION 

Response to Arguments 

1 . This communication is in response to the Amendment filed 7 February 
2008. 

2. Claims 1-8, 10 and 12-18 are currently pending in this application. In the 
Amendment filed 7 February 2008, claims 1,8, 10, 12 and 16-18 have been 
amended and claims 9 and 1 1 have been cancelled. This action is made Final. 

3. The rejections of claims 1 -5, 7,8,10,12,13 and 1 5-1 8 as being 
unpatentable over US Patent No 5,91 1 ,1 39 to Jain et al in view of US PGPub 
2002/01 36449 to Park et al in view of US Patent No 6,961 ,463 to Loui et al and 
of claims 6 and 14 as being unpatentable over US Patent No 5,911,139 to Jain et 
al in view of US PGPub 2002/0136449 to Park et al in view of US Patent No 
6,961 ,463 to Loui et al and further in view of US Patent No 7,010,144 to Davis et 
al have been withdrawn as necessitated by amendment. 



35 USC § 101 - Clarifications 

4. Claims 17 and 18 include a computer-readable medium. The medium is 
construed as being the ROM or storage medium mentioned on page 51, lines 20- 
23 and is considered to be limited to statutory mediums. 
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Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for 
all obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described 
as set forth in section 102 of this title, if the differences between the subject matter sought to 
be patented and the prior art are such that the subject matter as a whole would have been 
obvious at the time the invention was made to a person having ordinary skill in the art to which 
said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

5. Claims 1-5, 7, 8, 10, 12, 13 and 15-18 are rejected under 35 U.S.C. 
103(a) as being unpatentable over US Patent No 5,911,139 to Jain et al 
(hereafter Jain et al) in view of US PGPub 2002/0106135 to Iwane (hereafter 
Iwane) in view of US Patent No 6,961,463 to Loui et al (hereafter Loui). 

Referring to claim 1, Jain discloses an image processing method 
implemented by a computer for selectively storing an input image in a database, 
comprising the steps of: 

(a) acquiring first search information [alpha-numeric query] associated 
with the input image on the basis of information input by a user (see column 9, 
lines 11-15); 

(b) acquiring feature data [feature vector] contained in the input image as 
second search information (see column 9, lines 45-48); 

(c) searching for an original data file corresponding to the input image in 
the database by using the first [alpha-numeric query] and second [feature vector] 
search information (see column 9, lines 52-67); and 

(d) converting the input image into data [vector data] and storing the data 
in the database [database 132] (Jain: see column 9, lines 40-52). 
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However, Jain et al fails to explicitly disclose the further limitation of the 
data in step (d) being outline data and wherein the outline data indicates a visual 
representation of a tracing of the outline of a character or a graphic object. 
Iwane discloses obtaining an input image and then generating image information 
in order to compare objects (see abstract), including the further limitation of 
converting the input image into outline data and storing the outline data in the 
database (see [0244]), wherein the outline data indicates a visual representation 
of a tracing of the outline of a character or a graphic object (see [01 73]). 

It would have been obvious to one of ordinary skill in the art at the time of 
the invention to utilize the outlining method of Iwane in order to gather the feature 
information stored by Jain. One would have been motivated to do so in order to 
be able to extract features from an image in a case where OCR is not a viable 
solution (Iwane: see [0010]-[0012]). 

However, the combination of Jain and Iwane (hereafter Jain/lwane) fails to 
explicitly disclose the further limitation of (d) wherein the image is only stored in a 
case where the original file corresponding to the input is not found in said step 
(c); and (e) declining to store the input image data into the database, in a case 
that the image file corresponding to the input image is found in said step (c). 
Loui discloses a duplicate detection algorithm to determine whether two pictures 
are so similar that a consumer would only put one of them in the album 
[database], including the further limitations of wherein the image is only stored in 
a case where the image file corresponding to the input is not found in said step 
(c); and (e) declining to store the input image data into the database, in a case 
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that the image file corresponding to the input image is found in said step (c) (see 
column 4, lines 1 1 -51 ) since the concept of storing only one copy of an image 
increases storage efficiency and search efficiency. 

It would have been obvious to one of ordinary skill in the art at the time of 
the invention to utilize the duplicate detection algorithm of Loui with the storage 
system of Jain/lwane. One would have been motivated to do since the 
methodology of Loui can be embodied in any different types of systems (Loui: 
see column 7, lines 1 3-24) and since the concept of storing only one copy of an 
image increases storage efficiency and search efficiency. 

Referring to claim 2, the combination of Jain/lwane and Loui (hereafter 
Jain/lwane/Loui) discloses the method according to claim 1, further comprising 
the step of: (f) registering the first search information as an index [index value] for 
searching for the original data file in an index file (Jain: see column 7, lines 27- 
32). 

Referring to claim 3, Jain/lwane/Loui discloses the method according to 
claim 1, wherein the first search information comprises a keyword [keywords] for 
searching using the input image (Jain: see Fig 3, item 201 and column 9, lines 
11-15). 

Referring to claim 4, Jain/lwane/Loui discloses the method according to 
claim 1, wherein the first search information comprises a data size [file size] of 
the original data file (Jain: see Fig 3, item 201 and column 9, lines 1 1 -1 5). 

Referring to claim 5, Jain/lwane/Loui discloses the method according to 
claim 1, wherein the first search information comprises date information [File 
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Date] of the original data file (Jain: see Fig 3, item 201 and column 9, lines 11- 
15). 

Referring to claim 7, Jain/lwane/Loui discloses the method according to 
claim 1, wherein the second search information comprises a character code of a 
character recognition [face recognition] result which is obtained by performing a 
character recognition process with respect to a character region in the input 
image (Jain: see column 25, lines 31-41). 

Referring to claim 8, Jain/lwane/Loui discloses the method according to 
claim 1, wherein the second search information comprises feature data of each 
block obtained by the region segmentation of the input image (Jain: see column 
9, lines 45-67). 

Referring to claim 10, Jain/lwane/Loui discloses the method according to 
claim 1, further comprising the step of: (f) converting the input image, which has 
been converted into the vector data, into data in a format which can be handled 
by application software (Jain: see column 31, lines 12-14). 

Referring to claim 12, Jain/lwane/Loui discloses the method according to 
claim 10, further comprising the step of: (g) registering the first search 
information, in an index file, as an index [index value] for searching for an image 
represented by the outline data stored in the database in the step (d) (Jain: see 
column 7, lines 27-32). 

Referring to claim 13, Jain/lwane/Loui discloses the method according to 
claim 1, further comprising the step of: (f) outputting the original data file, wherein 
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pointer information is added to the original data file (Jain: see column 14, lines 7- 
19). 

Referring to claim 15, Jain/lwane/Loui discloses the method according to 
claim 1, wherein in the step (c), the original data file is searched for by using at 
least one of keyword search [keywords], full-text search, and layout search (Jain: 
see Fig 3, item 201 and column 9, lines 11-15). 

Referring to claim 16, Jain discloses an image processing system 
selectively stores an image file corresponding to an input image, comprising: 

an input unit constructed to input acquiring first search information [alpha- 
numeric query] associated with the input image (see column 9, lines 11-15); 

a unit constructed to search for acquiring feature data [feature vector] 
contained in the input image as second search information (see column 9, lines 
45-48); 

a search unit constructed to search for an original data file corresponding 
to the input image in a database by using the first [alpha-numeric query] and 
second [feature vector] search information (see column 9, lines 52-67); and 

a unit constructed to convert the input image into data [vector data] and to 
store the data in the database [database 132] (Jain: see column 9, lines 40-52). 

However, Jain fails to explicitly disclose the further limitation of the data 
being outline data and wherein the outline data indicates a visual representation 
of a tracing of the outline of a character or a graphic object. Iwane discloses 
obtaining an input image and then generating image information in order to 
compare objects (see abstract), including the further limitation of converting the 
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input image into outline data and storing the outline data in the database (see 
[0244]), wherein the outline data indicates a visual representation of a tracing of 
the outline of a character or a graphic object (see [01 73]). 

It would have been obvious to one of ordinary skill in the art at the time of 
the invention to utilize the outlining method of Iwane in order to gather the feature 
information stored by Jain. One would have been motivated to do so in order to 
be able to extract features from an image in a case where OCR is not a viable 
solution (Iwane: see [0010]-[0012]). 

However, Jain/lwane fails to explicitly disclose the further limitation of 
wherein the original data file is only stored in a case where the original data file 
corresponding to the input is not found by said search unit; and a unit 
constructed to decline storing the input image data into the database, in a case 
that the original data file corresponding to the input image file is found by said 
search unit. Loui discloses a duplicate detection algorithm to determine whether 
two pictures are so similar that a consumer would only put one of them in the 
album [database], including the further limitations of wherein the image is only 
stored in a case where no original data file corresponding to the input image is 
found by said search unit; and a unit constructed to decline storing the input 
image data into the database, in a case that the original data file corresponding 
to the input image file is found by said search unit (see column 4, lines 11-51) 
since the concept of storing only one copy of an image increases storage 
efficiency and search efficiency. 
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It would have been obvious to one of ordinary skill in the art at the time of 
the invention to utilize the duplicate detection algorithm of Loui with the storage 
system of Jain/lwane. One would have been motivated to do since the 
methodology of Loui can be embodied in any different types of systems (Loui: 
see column 7, lines 13-24) and since the concept of storing only one copy of an 
image increases storage efficiency and search efficiency. 

Referring to claim 17, Jain discloses a computer executable program 
stored on a computer-readable medium for selectively storing an image file 
corresponding to an input image, comprising: 

code [alpha-numeric query input module 106] for acquiring first search 
information [alpha-numeric query] associated with the input image on the basis of 
information input by a user (see column 9, lines 11-15); 

code [Query Canvas module 108 or Image Browsing Module 110 ] for 
acquiring feature data [feature vector] contained in the input image as second 
search information (see column 9, lines 45-48); 

code [VIR Engine 120 comprises modules] for searching for an original 
data file corresponding to the input image in a database by using the first [alpha- 
numeric query] and second [feature vector] search information (see column 9, 
lines 40-41 and 52-67); and 

code for converting the input image into data [vector data] and to store the 
data in the database [database 132] (Jain: see column 9, lines 40-52). 

However, Jain et al fails to explicitly disclose the further limitation of the 
data being outline data and wherein the outline data indicates a visual 
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representation of a tracing of the outline of a character or a graphic object. 
Iwane discloses obtaining an input image and then generating image information 
in order to compare objects (see abstract), including the further limitation of 
converting the input image into outline data and storing the outline data in the 
database (see [0244]), wherein the outline data indicates a visual representation 
of a tracing of the outline of a character or a graphic object (see [01 73]). 

It would have been obvious to one of ordinary skill in the art at the time of 
the invention to utilize the outlining method of Iwane in order to gather the feature 
information stored by Jain. One would have been motivated to do so in order to 
be able to extract features from an image in a case where OCR is not a viable 
solution (Iwane: see [0010]-[0012]). 

However, Jain/lwane fails to explicitly disclose the further limitation of 
wherein the image is only stored in a case where the original data file 
corresponding to the input is not found by said search unit; and code for declining 
storing the input image data into the database, in a case that the original data file 
corresponding to the input image file is found by said search unit. Loui discloses 
a duplicate detection algorithm to determine whether two pictures are so similar 
that a consumer would only put one of them in the album [database], including 
the further limitations of wherein the image is only stored in a case where no 
original data file corresponding to the input image is found by said search unit; 
and code for declining storing the input image data into the database, in a case 
that the original data file corresponding to the input image file is found by said 
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search unit (see column 4, lines 11-51) since the concept of storing only one 
copy of an image increases storage efficiency and search efficiency. 

It would have been obvious to one of ordinary skill in the art at the time of 
the invention to utilize the duplicate detection algorithm of Loui with the storage 
system of Jain/lwane. One would have been motivated to do since the 
methodology of Loui can be embodied in any different types of systems (Loui: 
see column 7, lines 13-24) and since the concept of storing only one copy of an 
image increases storage efficiency and search efficiency. 

Referring to claim 18, Jain discloses a computer-readable medium 
having a computer executable program stored thereon for search for an original 
data file corresponding to an input image, the program comprising: 

code [alpha-numeric query input module 106] for acquiring first search 
information [alpha-numeric query] associated with the input image on the basis of 
information input by a user (see column 9, lines 11-15); 

code [Query Canvas module 108 or Image Browsing Module 110 ] for 
acquiring feature data [feature vector] contained in the input image as second 
search information (see column 9, lines 45-48); and 

code [VIR Engine 120 comprises modules] for searching for an original 
data file corresponding to the input image by using the first [alpha-numeric query] 
and second [feature vector] search information (see column 9, lines 40-41 and 
52-67); and 

code for converting the input image into data [vector data] and to store the 
vector data in the database [database 132] (Jain: see column 9, lines 40-52). 
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However, Jain fails to explicitly disclose the further limitation of the data in 
step (d) being outline data and wherein the outline data indicates a visual 
representation of a tracing of the outline of a character or a graphic object. 
Iwane discloses obtaining an input image and then generating image information 
in order to compare objects (see abstract), including the further limitation of 
converting the input image into outline data and storing the outline data in the 
database (see [0244]), wherein the outline data indicates a visual representation 
of a tracing of the outline of a character or a graphic object (see [01 73]). 

It would have been obvious to one of ordinary skill in the art at the time of 
the invention to utilize the outlining method of Iwane in order to gather the feature 
information stored by Jain. One would have been motivated to do so in order to 
be able to extract features from an image in a case where OCR is not a viable 
solution (Iwane: see [0010]-[0012]). 

However, Jain/lwane fails to explicitly disclose the further limitation of 
wherein the image is only stored in a case where the image file corresponding to 
the input is not found by said search unit; and code for declining storing the input 
image data into the database, in a case that the image file corresponding to the 
input image file is found by said search unit. Loui discloses a duplicate detection 
algorithm to determine whether two pictures are so similar that a consumer would 
only put one of them in the album [database], including the further limitations of 
wherein the image is only stored in a case where no image file corresponding to 
the input image is found by said search unit; and code for declining storing the 
input image data into the database, in a case that the image file corresponding to 
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the input image file is found by said search unit (see column 4, lines 11-51) since 
the concept of storing only one copy of an image increases storage efficiency 
and search efficiency. 

It would have been obvious to one of ordinary skill in the art at the time of 
the invention to utilize the duplicate detection algorithm of Loui with the storage 
system of Jain/lwane. One would have been motivated to do since the 
methodology of Loui can be embodied in any different types of systems (Loui: 
see column 7, lines 1 3-24) and since the concept of storing only one copy of an 
image increases storage efficiency and search efficiency. 

6. Claims 6 and 14 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over US Patent No 5,911,139 to Jain et al in view of US PGPub 
2002/0106135 to Iwane in view of US Patent No 6,961,463 to Loui et al as 
applied to claim 13 above, and further in view of US Patent No 7,010,144 to 
Davis et al (hereafter Davis et al). 

Referring to claim 6, Jain/lwane/Loui discloses second search 
information. However, Jain/lwane/Loui fails to explicitly disclose the further 
limitation wherein the second search information comprises information 
associated with a storage location of the original data file which is extracted on 
the basis of pointer information in the input image. Davis et al also disclose 
second search information (see column 13, lines 5-14), including the further 
limitation wherein the second search information comprises information 
associated with a storage location [address] of the original data file which is 
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extracted on the basis of pointer information in the input image (see column 9, 
lines 1-16) in order to increase the efficiency and accuracy of locating the original 
data file. 

It would have been obvious to one of ordinary skill in the art at the time if 
the invention to use the feature the second information being associated with an 
address location as disclosed by Davis et al as the second search information of 
Jain/lwane/Loui. One would have been motivated to do so in order to increase 
the efficiency and accuracy of locating the original data file. 

Referring to claim 14, Jain/lwane/Loui discloses pointer information. 
However, Jain/lwane/Loui fails to explicitly disclose the further limitation wherein 
the pointer information is added as a digital watermark to the original data file. 
Davis et al also disclose pointer information (see column 14, lines 1 1-23), 
including the further limitation wherein the pointer information is added as a 
digital watermark to the original data file (see column 1 , lines 29-35) in order to 
embed auxiliary data, which may include one or more references, a machine 
instruction or set of instructions, and other data items about the image into the 
image. 

It would have been obvious to one of ordinary skill in the art at the time if 
the invention to use the feature of a digital watermark as disclosed by Davis et al 
as the pointer information of Jain/lwane/Loui. One would have been motivated to 
do so in order to embed auxiliary data, which may include one or more 
references, a machine instruction or set of instructions, and other data items 
about the image into the image. 
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Response to Arguments 

7. Applicant's arguments with respect to claims 1-8,10 and 1 2-1 8 have been 
considered but are moot in view of the new ground(s) of rejection. 

Conclusion 

8. Applicant's amendment necessitated the new ground(s) of rejection 
presented in this Office action. Accordingly, THIS ACTION IS MADE FINAL. 
See MPEP § 706.07(a). Applicant is reminded of the extension of time policy as 
set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire 
THREE MONTHS from the mailing date of this action. In the event a first reply is 
filed within TWO MONTHS of the mailing date of this final action and the advisory 
action is not mailed until after the end of the THREE-MONTH shortened statutory 
period, then the shortened statutory period will expire on the date the advisory 
action is mailed, and any extension fee pursuant to 37 CFR 1.136(a) will be 
calculated from the mailing date of the advisory action. In no event, however, will 
the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 
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Contact Information 

Any inquiry concerning this communication or earlier communications from 
the examiner should be directed to KIMBERLY LOVEL whose telephone number 
is (571)272-2750. The examiner can normally be reached on 8:00 - 4:00. 

If attempts to reach the examiner by telephone are unsuccessful, the 
examiner's supervisor, John Cottingham can be reached on (571) 272-7079. 
The fax phone number for the organization where this application or proceeding 
is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from 
the Patent Application Information Retrieval (PAIR) system. Status information 
for published applications may be obtained from either Private PAIR or Public 
PAIR. Status information for unpublished applications is available through 
Private PAIR only. For more information about the PAIR system, see http://pair- 
direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll- 
free). If you would like assistance from a USPTO Customer Service 
Representative or access to the automated information system, call 800-786- 
9199 (IN USA OR CANADA) or 571-272-1000. 

/John R. Cottingham/ Kimberly Lovel 

Supervisory Patent Examiner, Art Unit 2167 Examiner 

Art Unit 2167 

22 May 2008 
kml 
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